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DTAlVNOSTTC AND FOR MEDICAL GUIDED INTERVENTIONS 






USING MULTIPLE IMAGING SYSTEMS 






FIELD OF THE INVENTION I 

> 




; t 

i . 

!* 


The present invention relates to apparatus for performing medical diagnosis. 






medical interventions or theiapy planning and nicdieal hiia^c £ aided interventions 






when two or more medical imaging systems (such as on ultrasound* CT, MRI, X Ray) 






axe available for imaging a target in a body or body volume. Particularly, the present 






invention is related to apparatus for performing medical interventions, when 






employing medical imaging systems fur viewing the target during the intervention. 


; 


y 


BACKGROUND OF THE INVENTION 






During recent years fusing images from different medical imaging systems in ' 






order to receive a better diagnostic has become widely used. Additionally, the 






cooperative operation of several medical scanning devices can reduce the amount of ; 






radiation at which it a patient is subjected during diagnosis, therapy planning and 


1 




medical procedures ami inter v cations;. While these facts have been already 






recognized, the realization of such cooperative operation was until now restricted to 






medical imaging devices having a common mechanical platform. 
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SUMMARY Or THE INVENTION 



During diagnosis it is sometimes necessary oi helpful to operate several 
medical imag ing devices simultaneously or sequentially, upon necessity and 
compatibility between the devices, in order to indicate the condition of the patient 
and/or designate a target in a body or body volume. For example the same target can 
be viewed by ultrasound and by some other medical imaging device such as a CT. 
MRT or X-Ray. The current invention enables the accurate measuring of the relative 
position between the different imaging detectors by means of attaching position 
measuring components at known positions from each medical scanning head, 
canceling the necessity to have a mechanical connection between the different 
medical scanning devices. Measuring the relative position between the medical 
scanning detectors enables the calculation of the relative position between the 
scanning planes/volumes. The term position measuring components will define any of 
the following group: transmitter ot receiver or reflector or transceiver or optical 
indicia or any combination of the above, suitable to be part of a position measuring 
system. This position measuring system may be magnetic, acoustic or optic. 

The systems and methods of the present invention facilitate the combination of 
the advantages of a number of medical imaging devices to perform various medical 
diagnostic, therapy planning and intervention tasks more safely and efficiently than 
those of the conventional systems. 

Additionally, thB present invention enables placing one imaging device, tor 
example a CT or an X-JKay over the desired target to be viewed with greater precision, 
therefore reducing the necessary number of images to be taken by that imaging 
^device. === _ ==== ^_ = _^^^ ===== __ ==== __ == 
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Additionally, it enables to view a target with one medical imaging device and 






i 


guide a medical intervention tool or a medical therapeutic tool or insert a medical 






I 

i 


device when using a second medical imaging device. This can be particularly useful 






i 

t 


when employing image guided medical intervention systems such as those introduced 








by the assignees in commonly assigned U.S. Potent No. 5,647,373, entitled: 








Articulated Needle Guide For Ultrasound Imaging And Method Of Using Same, and 








patent applications, PCT/ll .96/0(1050 (WO 97/03609), entitled: Free-Hand Aiming 








Of A Needle Guide; FCT/IL98/0Q578, entitled; System And Method For Guiding 








The Movements Of A Device To A Target Particularly For Medical Applications; and 








PCT/IL9 8/00631, entitled; Calibration Method And Apparatus For Calibrating 








Position Sensors On Scanning Transducers, all four of these documents incorporated 






| 


by reference in their entirety herein. 






L -J 


Additionally, the present invention enables viewing of a target with one 






medical imaging device and monitoring of the progress of a medical intervention nr a 






medical therapy process or an insertion of a medical device with a second medical 




e 


imaging device. This again can be particularly useful when employing image guided 








medical intervention systems such as those introduced by the assignees in US Patent 




j 




No. 5,647,373, PCT/EL96/00050 and PCT/IL9$/0057S. 








The main object of the present invention is to provide methods and apparatus 








for combining two or more medical imaging systems (such as au ultrasound and a CT) 








iu medical diagnosis and procedures. 




i 




Another object of the present invention is to reduce mechanical constrains 








between the position of two medical imaging devices used to scan the same targel or , 








body volume. 
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Another object of the present invention is to enable the physician to free hand 


1 

1 

\ 






manipulate part or all of the medical imaging aevices useu m me b<uiic ihu-i vchuuu u* 


! 

| 






diagnosis. 








Another object, of the present invention is to reduce the amount of radiation 








applied on a patient during diagnostic and medical interventions and/or therapy. 








The proposed method and apparatus include a position measuring system inai 


1 






enables the establishment of the relative position between the two or more imaging 


i 






medical devices and between the image pianes/volumes produced by each medical 








imaging device. 








The method and apparatus disclosed in the present invention comprises at least 








two medical imaging devices, at least a display, a data processor, an Image processor, 


t 
1 


i 




said image processor can be pan of the data processor, and a position measuring 








system comprising position controlling and position measuring components, where 


1 






the position controlling component can be part of the data processor. 








The position measuring system enables establishment of the relative position 






3 


between the at least two medical imaging devices and between the image 








planes/volumes produced by said at least two imaging devices. 








The data processor receives the information from the position measuring 








system and uses it for at least one of the following; 






i 


a) maneuvering one or more imaging devices in order lo scan the interest 








target within the body according to information available trom anotner meaicai 








imaging device, or 








b) facilitating image fusing when images of same plane/volume are available 








from two ox more imaging devices. 
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1 



As a result of the processed data a medical intervention device can be guided 
for performing medical therapy procedures or inserting a medical device according to 
information received from one imaging device while monitoring the above operations 
with the help of another medical imaging device. 

The method and apparatus arc beneficial in mot; they have add-on capabilities 
and one can define dynamic architectures, and they enable tree -hand maneuvering of 
all or part of the imaging devices. 
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BRIEF DESCRIPTION OF THE DRAWINGS 

The present invention will now be described by way of the accompanying 
drawings, wherein like reference numerals and/or characters indicate corresponding or 
like components. In the drawings: 

FIG. la pictorially illustrates one form of a system constructed according in 
accordance with the present invention for ennperative operation of an ultrasound and 
a computerized topography (CT) apparatus; 

FIG, lb pictorially illustrates the relative position between tha scanning beams 
of the CT and ultrasound in FIG. la: 

FIG. 2a is a vector diagram which pictorially illustrates the vectors used in 
calculating the relative position between the scanning beams of the ultrasound and the 
CT in FIG la; 

FIG. 2b is a block diagram illustrating the steps involved in calculating the 
relative position between the scanning beams of the ultrasound and the CT in FIG 1 a.; 

FIG. 3 pictorially illustrates display functions enabled according to the present 
invention in relation to FIG. la; 

FIG. 4a pictorially illustrates one possible position measuring system to he 
used in accordance to the present invention; 

FTG. 4b pictorially illustrates another possible position measuring system to be 
used in accordance to the present invention; 

FIG3. 5a and 5b pictorially illustrate another form of a system eotwtructed 
according in accordance with the present invention for cooperative operation of an 
ultrasound and a CT; 



6 



P-2202-USr > 



31. MGR. 1999 11:21 



eiTGN PEARL LATZER+C0HEN-2EDEK 



,on865 • .nu9 



m 



FlGs. 6a and 6b pielorially illustrate another form of a system constructed 
according in accordance with the present invention for cooperative operati n of an 
ultrasound and a CT; 

FIG. 7 illustrates a CT with capability of electronically or mechanically 
changing lis scanning plane; 

FIG. 8 is a simplified flowchart illustrating the steps of using in a cooperative 
mode two medical scanning devices in accordance to the present invention; 

j/iO. 9 pictorially illustrates one form of a system constructed according in 
accordance with the present invention for cooperative operation of an ultrasound and 
a X-Ray; 

FIGs. 10a and 10b pictorially illustrate another form of a system constructed 
according in accordance with the present invention for cooperative operation of an 
ultrasound and a MRI; and 

FIG. 1 1 pictorially illustrates the reference sc anning plane of an MRL 
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DETAILED DESCRIPTION OF THE DRAWINGS 

FIC la illustrates a first embodiment, exemplary of the present invention. The 
fo-st embodiment titilt7.es at least two compatible devices thai produce medical 
images. Here, the image producing devices include an ultrasound apparatus 2, and a 
computerized tomography (CT) apparatus A, employed in a cooperative operation. 
Alternately, the image producing devices could be. the same or different devices, or 
combinations thereof, provided they operate cooperatively with respect to each other 
and are compatible. For example, these devices may be devices that produce images 
by ultrasound, computerized tomography (CT), Magnetic Resonance Imaging (MR1), 
X-ray, endoscopy etc. 

Here, for example, images produced by CT 4 of a body 6 (or body volume) of 
a target 8 in the body 6 (body volume) may be utilized to guide a medical ultrasound 
driven intervention by accurately pin-pointing an area required to be treated that 
cannot be imaged as accurately by ultrasound. Also, images produced by ihe two 
medical imaging devices may be combined in real-time or off-line Co produce the 
detail required in the area of Ike image required. The system can be fitted to existing 
and deployed medical imaging devioes without major modifications or adaptations. 

Ultrasound 2 and CT 4 are connected to a display 1 0 via an image processor 
12 (optional) contained in data processor 14, for displaying on display 10 at least the 
images of ultrasound 2 and CT 4. Ultrasound 2 and/or CT 4 may also be connected 
directly to display 10 via the necessary connections and hardware. Image, processor 1 1 
may be part of data processor 14 or can he connected to it. 
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Ultrasound 2 comprises a main unit 16 connected to a scanning head 1 8 
further referred to as the ultrasound transducer as is Jknown in the art. CT 4 comprises 
a main unit 20 connected to a scanning head 22. Anther referred as a CT scanning 
head. CT scanning head 22 includes X-ray emitter and detector(s) (not shown) as is 
known in the art. The term scanning head will be used to define the detector and/or 
emitter component of the medical imaging or scanning device, such as the transducer 
of an ultrasound or the coils of a MM, or the X-ray emitter and detccturOi) of a CT or 
an X-ray. Bed 24 may or may not be part of CT imaging device 4. 

A position measuring system comprising at least a position sensing controller 
26 and position measuring components 28 and 30 j$ used to measure the relative 
position between ultrasound transducer 1 8 and CT scanning head 22. The term 
position measuring components will define any of the following group j transmitter or 
receiver or reflector or transceiver cr optical indicia or any combination of the above, 
suitable to be part of a magnetic (for example, in accordance with the systems detailed 
in I l.S. Patents Nos. 4,314,251, 4.054,881) or acoustic (for example, in accordance 
with the sysLem detailed in U.S. Patent No. 4,124,838) or optic (for example, in 
accordance with the system detailed in U.S. Patent No, 4,649,504) position measuring 
system. Position sensing controller 26 can be part ofdata processor 1 4. 

In order tn perform the task of measuring the relative position between 
ultrasound transducer 18 and CT scanning head 22, position measuring component 28 
is attached at a known and fixed position with respect to the ultrasound transducer 18. 
The attachment can be either directly tn the transducer 18 or by means of an 
extension. Likewise, position measuring component 30 is attached at a known and 
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fixed position from CT scanning head 22. The term position defines location and/or 
orientation. 

Position sensing controller 26 measures the relative position between position 
measuring component 28 and position measuring component 30, enabling to calculate 
the relative position between ultrasound transducer 18 and CT scanning head 22. 

Reference is now made to FIG. lb that shows a detailed view of ultrasound 
transducer 18, CT scanning head 22 and position measuring components 23 and 30. 
Items referred tn in previous figures are numbered similarly and will not be further 
described. 

Position measuring component 28 is calibrated to ultrasound transducer 1 8 
such that the ultrasound scanning beam 32 is at a known and fixed position with 
respect to position measuring component 28. Such calibration can be achieved by 
operating according lo PCT application PCT/IL98/00631. 

Likewise, position measuring oomponent 30 is calibrated to scanning head 22 
such that the CT scanning beam 34 is at a known and fixed position with respect to 
position measuring enmpnnent 30. Such calibration can be achieved by operating 
according to the co-assigned PCT application PCT/TL98/0063 1. 

These calibrations enable calculation of the relative position between 
ultrasound scanning beam 32 and CT scanning beam 34 based on measuring the 
relative position between position measuring components 28 and 30> and based on ihc 
calibration values defined above. The vector diagram of FIG. 2a and flowchart of 
FIG. 2b illustrate one possible algorithm to be used for calculating the relative 
position between the beams of the two medicaJ scanning devices. 
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Reference to flowchart of FIG. 2b, block 40 shows the result nf the calibrating 
position measuring component 28 to ultrasound transducer 18. Block 42 shows the 
result of the calibrating position measuring component 28 to ultrasound transducer 18. 
Blocks 40 and 42 arc performed off-line. Block 44 shows the measurement of the 
relative position of position sensor 28 with respect to position sensor HU. Block 46 
shows one possible set of equations (Equations 1 and 2 described below) for 
calculating the relative position between ultrasound scanning beam 32 and CT 
scanning beam 34. These equations arc: 



P^Jus.s.b t^rXOo -^usXb / 



CEq. 2) 



The indexes and parameters in the above equations arc according to vector diagram of 
FIG. 2a and flowchart of FIG. 2b. 

In one exemplary use of the invention target 8 within a body 6 is scanned wiih 
the ultrasound transducer 18. The posiuonof ihc CT scanning beam 34 is calculated 
wiih respect to the ultrasound beam 32 as explained above. 
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Referring to FIG. 3, the relative position of CT scanning beam 34 with respect 
to the ultrasound scanning beam 32 is indicated to the operator in a 2-D and/or 3-D 
fashion on display 10, by hoxes 60 and 62 respectively. The above relative position 
can also be superimposed on the ultrasound image 64, including the image of target 
8\ for example in the form of a crossing line 66 and data box 68. The amount of 
deviation of CT scanning beam 34 from ultrasound scanning beam 32 can also be 
displayed to the operator, for example in the from of angles and distances, as in box 
68. This enables the operator to fust position ultrasound transducer 1 8 such as to view 
a uu kcI 8 or a desired scanning plane and then position the CT scanning head 22 such 
that the two scanning beams 34 and 32 coincide, or such that CI scanning beam 32 
views target 8 or part of it It is then possible to remove ultrasound transducer 18 and 
scan body 6 by CT 4 such that CT scanning beam 34 is scanning target 8 or a 
plane/volume of interest. 

Additionally, target 8 can be marked by the operator on the image produced by 
the ultrasound 2 as shown on the display 10. This can be performed for example, by 
marking software in conjunction with a mouse or by other standard computer based 
interactive procedure. The position of CT scanning head 22 and scanning beam 34 can 
then be calculated with respect to the target 8, thus enabling the operator 10 position 
CT scanning beam 34 so as to view the target 8. 

Alternately, the operator can scan body 6 by ultrasound 2 and based on 
ulUasound image 64 on display 10 a reference plane can be indicated by the operator, 
for example in the form of clicking a button. This enables to define a reference 
plane/volume of body 6 to be then scanned at a greater resolution by CT 4. 
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Thus, the operator may manually command the maneuvering of the CT 
scanning head 22 in position based on the instructions available on the display 10. 
AiternateJy, the system can be made fUlly automatic and the maneuvering commands 
may be Issued from Jala processor 14 by an optional link to CT 4. 

In applications requiring very high accuracy it is necessary to constrain body 6 
in order to avoid small movements between scanning body 6 by ultrasound 2 and 
scanning body n by CT 4. In most applications mis requirement is not necessary. 

An additional implementation to be used in connection to the present 
invention may be to correlate and/or fuse ultrasound image/information with CI* 
image/information to produce a superimposed or combined image/information, also 
known as a "JRiseri" image, that has the advantages of both technoloKics. Body volume 
6 is scanned by CT 4 producing high resolution image/information. Target S is 
defined by the operator on CT image as displayed on display 10. Target 8 is then 
scanned by ultrasound transducer 1 8. The position of the ultrasound scanning beam 
32 is detennied by the position measuring components (as detailed above) as is the 
position of the CT scanninjK beam 34. Based on the measured positions of the 
ultrasound and CT scanning beams 32, 34, as determined in accordance with the 
present invention, the ultrasound image information may be correlated or fused with 
CT image information by the image processor 12, employing conventional image 
processing algorithms and techniques. By correlating or fusing these images (from 
the ultrasound and CT scanning beams, respectively), the displayed ultrasound image 
may be enhanced. Also, the image correlation and/or fusing may be used in an 
iterative mode in order to improve the cakulaliou of the relative position between 
ultrasound scanning beam 32 and the CT scanning beam 31. 
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Reference is now made to FIG. 4a that illustrates a magnetic position 
measuring system to be used in accordance with an exemplary embodiment of the 
present invention. Similar items in previous figures have similar numbers and will not 
be further described. 

In this exemplary embodiment position measuring component 28 is a receiver 
28 s being attached to ultrasound transducer 18 and position measuring component 30 
is a transmitter 30' being attached to CT scanning head 22 by an arm SO'. Transmitter 
30' is trausuiitting AC or DC magnctic/eleotromagnetic signals to receiver 28', The 
output of receiver 28' is transmitted by wire or wireless connections to position 
sensing controller 26 enabling tn calculate the relative position of receive* 28* with 
respect to transmitter 30'. Alternately, position measuring component 28 could be a 
transmitter mid position measuring component 30 could be a receiver. 

Reference is now made to FIG. 4b wherein an optical position measuring 
system is employed in accordance with another exemplary embodiment of the present 

h 

Q invention. Similar Items in previous Inures have similar numbers and will not be 

jl further described. A stereo vision charge coupled device (CCD) camera 84' is 

positioned on an arm 86* at a first reference location. Position measuring component 
28 includes a cluster of I .KO's 28" being attached to ultrasound transducer 18 by an 
arm 88* and position measuring component 30 includes a cluster of LED's 30" being 
attached to CT scanning head 22 by an arm 80 ! \ The relative position of cluster of 
LED's 28" i3 measured with respect to the CCD camera 84* (first reference location), 
and also the relative position of cluster of LED's 30" is measured with respect to 
CCD camera 84* (first rcfeience location). It is therefore possible to calculate from 
the above measurements the relative position of cluster of LED's '*<>" with respect to 



fu 



to 

f 
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cluster of LED'9 28' ' and hence, the relative positi n between ultrasound scanning 








beam 32 and CT scanning beam 34. 


i 
1 






The above detailed position measuring systems enable measurement of the 


i 






relative position between ultrasound transducer scanning beam 32 and CT scanning 


I 






beam 34 can be optical, acoustic ox magnetic. The relative position between position 


i 






measuring components 28 and 3 0 can be measured directly, for example, when one of 








the components is a receiver and the other one is 4 transmitter as illustrated in the 


i 






exemplary embodiment hi FIG. 4a, Alternately, the relative position between position 








measuring components 28 and 30 can be calculated indirectly, for example, by 


i 






measuring the position of each with respect to a reference location as illustrated in the 








exemplary embodiment in PIG. 4b. 


i 
; 






When making these indirect calculations, a third position measuring 






rU 


component 84 (illustrated in FIG. 4b by a stereo Charge Coupled Device (U/.l >) 84') 








is in operative communication with position measuring components 28 and 30, this 








CCD 84 is positioned at a first reference location. The first reference location may be 






□ 


fixed and known. Alternately, the first reference position con be movable and 








unknown. Optionally, the first reference position can be attached to the bed V.4. 








Position measuring components 28, 30 and 84 (if part of the system) may be 








any of the following group; transmitter or receiver or reflector or transceiver or 






\ 


optical indicia oi any combination of the above, suitable to be port of a magnetic or 








acoustic or optic position measuring system. 








Position sensing controller may communicate with at least one or all of 








position measuring components 28, 30 and 84 (if part of the system) by wired or 






t 

L ... 


wireless links. 
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Reference is now made to FIGs. 5a and 5b, which illustrate a system 
configured according to another exemplary embodiment of the present invention. 
Similar items to those in previous figures have similar numbers and will not he further 
described. In this exemplary embodiment, position measuring component 30" is 
detached from CT scanning head 22 and attached via au anu 80" at a known and 
fixed position with respect to bed 24. The position of bed 24 is fully calibrated with 
respect to CT scanning head 22, thiB calibration in accordance with conventional CT 
devices that employ beds or the likft. 

As a result of this calibration, the position of the CT scanning beam 34 is 
known with respect to position measuring component 30* at all tiroes and all positions 
of bed 24. If movement of bed 24 is controlled by CT main unit 20. the information 
regarding the movement of bed 74 may be transferred from CT main Unit 20 to data 
processor 14. Alternately, the movement of bed 24 may be controlled directly by data 
processor 14. Thus, the modalities of employing in operative cooperation ultrasound 2 
and CT 4 arc similar to those enabled by the system illustrated in F1U. la. 

Alternately, with reference to >'K»s. 6a and 6b, an indirect position measuring 
system may be employed comprising position measuring component 84 at a first 
reference location. In this exemplary embodiment position measuring component 84 
could be a transmitter and position measuring components 30* and 7X could be 
receivers all part of a magnetic position measuring system. The illustrated indirect 
position measuring system enables to monitor ihc movement of bed 24 directly 
through position sensing controller 26. 
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Reference is iww made to FIG. 7 illustrating a CT scanning head 22 wherein 
CT scauuing plane 34 may be changed electronically or mechanically. Similar items 
to those in previous figures have similar numbers and will not be further described. 

In this exemplary embodiment position measuring component 30 may only be 

calibrated to a reference CT scanning plane 34% but not to all possible CT scanning 

planes. Information regarding the relative position between any CT scanning plana 34 I 

with respect to CT retexftnee scanning plane 34' will be outputted from the CT main j 

unit 20 to data processor 1 4 enabling to calculate the position of the actual CT J 

scanning plane 34 with respect to position measuring component 30. Thus, the | 

I 

modalities of employing in operative cooperation ultrasound 2 and CT 4 are similar to j 

those enabled by the system illustrated in FIG. la, as detailed above. | 

Reference is now made lo FIG. 8 which is a flow-chart illustration of the steps 
required in order to operate two medical imaging devices in operative cooperation in 

accordance to the present invention. At step 90, it is measured ihe relative position j 

between position measuring components 28 and 30 (P.M.C. in FIG. 8) being at known J 

positions with respect 10 ultrasound transducer 1 8 and CT scanning head 'A2 j 

t 

respectively. At step 94 it is calculated the relative position between ultrasound | 
scanning plane/volume 32 and CT scanning plane/volume 34. The calculation at step 1 
94 is based on knowing the position of CT scanning plane/volume 31 with respect to 
position measuring component 30 and the position of CT scanning plane/volume 34 
with respect to position measuring component 28 (step The relative posiuon 
information calculated in step 92 may also be used in other medical procedures (step 
96) that is optional, but preferred, for example in image guided interventions, such as 
described in co-assigned TJ.S. Patent No. 5,647,373. The relative position information 
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calculated in step 92 may also be used in aider to Instruct Hie positioning of CT 
scanning head 22 and ultrasound Transducer 18 with respect to each other (step 170). 
Once the relative position between the scanning planes/volume is calculated the 
images from CT 4 and ultrasound 2 may be correlated and or fUsed in optional, but 
highly preferred step 98. The superimposed image/inforniation resulting of step 98 
may be optionally used to improve calculation at step 92 in on iterative mode. *i*b,e 
superimposed unage/infonnaLiou resulting of step 98 may also be used in other • 
medical procedures (step 96) or in order to instruct the positioning Of CT scanning 
head 22 and ultrasound transducer 1 8 with respect to each other (step 120), 

The imaging options 100 are nou-exLuwstivcly, listed as follows. The image 
lirnm CT 4 and ultrasound 2 may be displayed individually (steps 102 and 104), the 
U] relative position between CT and ultrasound scanning beams may be displayed (step 

?H 106) and the result of image fusing, at step 98 may also be displayed (step 108). 

; Z l In addition to and interacting with display functions 100, there are various 

1 ancillary functions such as optionally marking a target 8 (step 1 12) on the image 

jjyj produced by one of the imaging devices as appearing on display 10. Then ihe position 

j\T of target 8 may be calculated within the scanning beam of the medical imaging 

N device, (step 114). Adm'tionally/alieniatcly a reference plane/volume may be marked 

i or signaled according to the image produced by one of the imaging device (step 1 16). 

! The position of the reference plane/volume may then be calculaied (step 1 18). The 

data in steps 1 1 4 and/or 118 may he optionally used in order to instruct the 
j positioning of CT scanning head 22 and ultiasouud transducer 18 with respect to each 

other (step 120). 
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Reference is now made to FIG. 9, which illustrates an additional embodiment 






of the present invention. Similar items to those shown in previous figures have similar 






numbers and will not further be described. The second embodiment illustrates an 






ultrasoiinri 2, and a X-Ray 133 to be used in cooperative operation according to the 






present invention. The X-Ray imaging device comprises X-Ray main unit 140 and 






X-Ray scanning head 142 including emitter 142* and detector 142*. X-Ray scanning 






head 142 is mounted on a movable and adjustable aim 144. Bed 24 may or may not be 






part of .X-Ray imaging device 138. 






Position measuring component 30 is attached at a known and fixed positions 






from X-Ray scanning head 142, Additionally, position measuring component 30 is 




1 


calibrated to the scanning head 62 such thai it is at a known position from the 




•v_ | 


scanning volume of the X-Ray. Such calibrations can be achieved by operating 




OH 


according to patent application PCT/IL9S/0063 1. The relative position between 




-t 

i 


ultrasound transducer scanning beam 44 and the X-ray scanning volume 146 con be 






calculated as described in the first embodiment based on direct measurement between 




lI 
U 


position measuring components 28 and 30. * , 




j 


An additional position measuring component £4 is placed at a reference ' 




| 


location on an arm 86. This position measuring component 84 is hi cooperative 






communication with position measuring components 28 and 30. Thus > the position of 




i 

i 
1 


ultrasound transducer 42 and of the X-Ray scanning head 62 are measured with 




i 
I 


respect to the reference position similar to the calculation described in relation to FIG. 




1 
! 


4b. Dody 6 is fixed bo as to avoid movement during the procedure. X-Ray scanning 






head 1 42 is positinned in order to view uuget 8 in the body 6 or body volume at. two 




i 


different positions. The position of X-Ray scanning head 14*2 is measured with 
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respect to reference position thus enabling 10 correlate the two images into stereo 
information in OTderto receive a 3D image of the scanned body 6. Algorithms for 
creating such 3D imttge/Lifoxmation are conventional in the art. 

In one exemplary use of present invention, the Operator may indicate target 8 
on the image received from The X-Ray 138 for example, by marking it with a mouse 
on the display 10 (as described herein above with reference to FIGs. 1-3). J/he relative 
position of target 8 can be calculated with respect to the reference point. Ultrasound 
Uajisducer 18 is then applied to body volume 6 and its position is measured with 
respect to the reference position. Thus, it is possible la calculate the position of 
ultrasound scanning plane 32 with respect to the image volume received from X-Ray 
138 and target 8, 

Alternately, the body volume 6 is first imaged by ultrasound in order to 
establish a desired xeferenAft plane/volume that includes a target 8. The operator 
selects a reference plane, in accordance with the procedures detailed above. 
Alternately, the opezator the operator indicates target 8 tor example by marking it on 
the display 10, using conventional marking software, as described above. Data 
processor 14 stores the position of target 8 or of reference plane with respect to the 
^ reference location. Ultrasound transducer 22 is then removed and the position of 

i 

I X-Ray scanning head 34 is calculated with respect to reference plane or target 8. 

| Thus, it is then possible to position X-Ray scanning head 142 in an optimal way at 

I 

I two different positions so as two view target 8 and afterwards produce a 3D 

imagft/information. 

| Additional modalities of employing in operative cooperation ultrasound 2 and 

X-Ray 138 are similar to those described for the system illustrated in FIGa. la 7 and 
• described above. 
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Reference is now made to FlGs. 10a, 1 Ob and 1 1 which illustrate an additional 






embodiment of the present invention- Similar items to those shown in previous figures 






have similar numbers and will not further be described. The third embodiment 






illustrates an ultrasound 2 and an MRI 138 to be used in cooperative operation. MRI 






V*X comprises MM main unit 160 and MRI scanning head 1 62. Bed 24 may or may 






not be part of MRI imaging device 158. ^ 






The cooperative operation between ultrasound 2 and MRI 158 is similar to that 1 






in the previous embodiments except for the necessity to operate the ultrasound 2 ( 






above a minimal required distance from MRI scanning head 1 62 (depending on die ■ 






strength of the magnetic field of MRI 158 and ultrasound 2 compatibility). Thus, body ! 






! 

6 is scanned by ultrasound transducer 1 8 such llmt ultrasound 2 (and particularly 






ultrasound transducer 1 Jt) is ahnve minimal required distance fram MKT snanr>in£ 1 




! x - * 


head 162. This minimal required distance varies from one type of MRI to another. In 






the exemplary embodiment illustrated in FlCJs. 1 0a and 10b the iniiiiuial inquired 

r 






distance requires to move body 6 on bed 24 a certain distance from the MRI scanning ' 




w 


area. According to the exemplary embodiment in FIGs. 10a, 10b and 1 \ 3 position 1 

i 






measuring component 30 is attached through an arm 80' " at a known and fixed i 






f 

position with respect to bod 24. ! 






The necessity to move bed 24 between MRI scanning and ultrasound image 






requires measurement of the movement of bed 24 by one of the methods described 






herein above in connection to FIG3. 5a, 5b, 6a and fib. The position of bed 24 may be 






calibi"ated with respect to MRI scanning head 1 62 such that position of MRI reference 


1 

i 




scanning plane 164* is known with respect to position measuring component 30. 






MRI scanning plane 164 may be changed by electronic means. Thus, position 






measuring component 30 may only be calibrated to a reference MRI scanning plane 
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164*, and not to all possible MRl scanning planes 164. Infonnation regarding the 
relative position between the actual MRJ scanning plan© 164 with respect tn MKI 
reference scanning plane 164' will be outputted from MRJ main unit 160 to data 
processor 14. Thus the position of actual MRJ scanning plane 164 wilh respect to 
position measuring component 30 can be calculated as described herein above with 
respect to FIG. 7. 

The cooperative operation of ultrasound 2 and MRI 15X may also be obtained 
by using alternative systems herein above described in connection to embodiments 
illustrated in FIGs. la - 8. 

Thus, the modalities of employing in operative cooperation ultrasound 2 and 
MKI 158 are similar to those enabled by the system illustrated in above embodiments 
illustrated in FIGs. la - 8. 

While the invention has been described With respect to several preferred 
embodiments, it will be appreciated thai these arc set forth merely for purposes of 
example, and mat many variations, modifications and applications of the invention 
may be made. Accordingly, the scope of the invention is defined by the claims which 
follow. 
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CLAIMS 



l. A method enabling free of predefined mechanical constraints cooperative 
operation of two or more medical summing devices useful in medical diagnosis and/or 
medical therapy planning and/or medical intervention planning and/or medical 
therapy and/or medical intervention and/or medical procedures, die method 
comprising the steps of: 

scanning a body volume/plaue with at least one first medical scanning device;; 
sensing the position of an at least one second medical scanning device willi 
respect to said at least first medical scanning device by means of a position measuring 
system comprising position measuring controller and position measuring components; 

scanning pan or all of said body volume/plane with at least one second 
medical scanning device; 

calculating the relative position of said at least one second medical scanning 
device and/or relative position of the scanning plane/volume produced by said at least 
one second medical scanning device with respect to said at least one first medical 
scanning device and/or with respect to the scanning plane/volume produced by said at 
least one first medical scanning device; 

displaying on at least one display screen said calculation in a cooperative way 
to the medical operator. 



2. The method according to claim 1 where the at least one first medical scanning 
device is one. 
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3. The method according to claim I where The at least one second medical 
scanning device is one. 

4. The method according to olaim 1 where the at least one display screen is one. 

5. The method according to claim 1 where said at least one first and said at least 
one second medical scanning device operate sequentially. 

6. The method according to claim 1 where said at least one first and said at least 
one second medical scanning device operate simultaneously and/or intermittently. 

7. The method of claim 1 where the at least one first medical scanning device ia 
one of the group X-Ray, CT, MRI or ultrasound 

8. The method of claim 1 where the at least one second medica) scanning device is 
one of ihe group X-Ray, CT, MR! or ultrasound. 

9. The method of claim 1 where the at least one second medical scanning device is 
an ultrasound. 



10. The method of claim 1 where the at least one ILst medical scanning device is 
an ultrasound. 
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1 1 . The method of claim I where the position measuring system is magnetic. 

12. The method of claim I where the position measuring system is optic, 

13. The medio d of claim 1 where the position measuring system is acoustic, 

14. The method of claim 1 where ihe step of sensing the position of an at least one 
second medical scanning device with respect to aaid at least first medical scanning 
device is performed by means of wired communication. 

15. The method of claim 1 where the step of sensing the position of an at least one 
second medical scanning device with respect to said at least first medical scanning 
device is performed by means of wireless communication. 

16. The method according to claim 1 where die position of the said at least one 
second medical scanning device is calculated with respect to said at least one first 
medical scanning device. 

17. The method according to claim 1 where ihe position of the said at least one 
second medical scanning device is calculated with respect to the scanning 
plane/volume produced by said at least one first medical scanning device. 
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i 

l 

18. The method uccuiding to claim 1 where the position of the scanning | 






plaacArolumc produced by said at least ne second medical scanning device is 






calculated with respect to said at least one first medical scanning device, i 

1 




'• 
1 


I 

1 9. The method according to claim 3 where the position of the scanning | 




i 


plane/volume produced by said at least one second medical scanning device is' ^ 






calculated with respect to the scanning plane/volume produced by said at least one j 




! 


first meriical scanning device. j 

i 

f 




?i 


1 
j 

20. The method according to claim 1 where the scanned plane/volume produced 




L_£: 


by said at least one first medial scanning device is correlated uud/or fused by image 






processing tools with the scanned plane/ volume produced by 3oid at least one second , 




1 


medical scanning device. 






21 . The method according to any of the claims 20 where said information 




u 


correlation and/or fusing Is used to improve said calculation of relative position 






between the scan plane/Volume produced by said at least one first medical scanning 






device and the scon piano/volume produced by sflirl at leasi one second medical 






scanning device. 


1 




22. The method according to claim 21 where said improvement of sain* calculation 






and said information correlation is performed in an iterative way. 
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23. The method according to claim 1 farther comprising the step of indicating tn 
said position sensing system the position of a target by marking said target on said ai 
least one display screen. 

24. The method according to claim 1 further comprising the step of indicating to 
said position sensing system the position of a target by detecting said target by image 
processing tools. 

25. The method according to claim 1 further comprising the step of indicating to 
said position sensing system the position of a reference plane/volume by marking said 
reference plane/volume on said at least one display screen. 

26. .1 "he method according to claim 1 further comprising the step of indicating to 



" said position sensing system the position of a reference plane/volume by manually 



producing an indicia in the form of a signal 

27. '( he method according to any of the claims 23-26, where the position of the 
said at least one second medical scanning device is calculated with respect to said 
target and/or said reference plane/volume. 

23. The method according to claim 1 where the position of the scanning 
plane/volunio produced by the said at least one second medical scanning device is 
calculated 'with respect to said target and/or said reference plane/ volume. 
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29. The method according to claim 1 and further comprising the step of indicating 
on said at least one display screen the actual progressive motion of said al least one 
second medical scanning device towards said target and/or reference plane/volume. 

30. The method according to claim 1 and further comprising the step of indicating 
on said at least one display screen the deviation of said at least one second medical 
imaging device or scanning plane/volume produced by said at least one second 
medical scanning device from said target and/or from said reference plane/volume. 

31 . The method according, to claim 1 and further comprising the step of adjusting 
the posi tion of said at least one 3eoond scanning device so as to cause it to include in 
its scan ploneA'olume said target or to cause thai its scan plane/volume coincide with 
said reference plane/volume. 
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32. Apparatus enabling free of predefined mechanical constraints cooperative 
operation of two or more medical scanning devices useful in medical diagnosis aadVor 
medical therapy planning and/or medical intervention planning and/or medical 
xherapy and/or medical intervention and/or medical procedures, apparatus comprising. 

at least one first medical scanning device; 
at least one second medical scanning device; 

a position measuring system comprising at least the following: a position 
sensing controller and at least one first position measuring component ax a known 
position with respect to said at least one first medical scanning deviec'aud at least one 
second position measuring component at a known position with respect to said at least 
one second medical scanninK device; 

a data processor for receiving data from the position sensing controller for 
calculating the relative position of said at ie.ast one second medical scanning device 
and/or relative position of the scanning plane/volume produced by said at least one 
second medical scanning device with respect to said at least one first medical 
scanning device and/bx with respect to the scanning plane/voiume produced by said at 
least one first medical scanning device, said data processor displaying oil at least one 
display screen said calculation in a cooperative way to the medical operator. 

33. Apparatus according to claim 32 where the at least one first medical scanning 
device is one. 
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34. Apparatus according to claim 32 where the at least one secoud medical 
scanning device is one. 

3fi. Apparatus according to claim 32 where the at least one display screen is one. 

36. Apparatus according to claim 32 where said at least one first and said at least 
one second medical scanning device operate sequentially. 

37. Appaiutus according to claim 32 where said at least one first and said at least 
one second medical scanning device operate simultaneously and/or intermittently, 

38. Appaxarus of claim 32 where the at least one first medical scanning device is 
one of the feioup X-Ray, CT, MRI or ultrasound. 

39. Apparatus of claim 32 where the at least one second medical scanning device 
is one of the group X-Ray, CT, MRI or ultrasound. 

40. Apparatus of claim 32 where the at least one secoud medical scanning device 
is an ultrasound. 

41. Apparatus of claim 32 where the at least one first medical scanning device is 
an ultrasound. 
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42. Apparatus of claim 32 where the position measuring system is magnetic, 

43. Apparatus of claim 32 where ihe position measuring system is optic. 

44. Apparatus of claim 32 where the position measuring system is acoustic. 

45. Apparatus of claim 32 where die step of sensing the position of an at least one 
second medical scanning device with respect to said at least first medical scanning 
device is performed by means of wired communication. 

46. Apparatus of claim 32 where the step of sensing the position of an at least one 
second medical scanning device with respect to said at least first medical scanning 
device is performed by m«ans of wireless communi caiion- 

47. Apparatus according to claim 32 where the position of the said at least one 
first position measuring component is on said at least one first medical scanning 
device. 

4S. Apparatus according to claim 32 where the position of the said at least one 
second position measuring component is on said at least one second medical scajuiiug 
device. 

49. Apparatus according lo claim 32 where said position sensing controller is 
included in die data processor. 
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50. Apparatus according to claim 32 where said at least nne first position 
measuring component and said at least one second position measuring component 
work in operative communication. 

» 

5 1 . Appararus according to claim 50 where said calculation is based on the j 
operative communication between said at least one first position measuring ( 
component and said at least one second position measuring component. 

i 

I 

52. Apparatus according to claim 32 where said position manning system j 

additionally comprises at least one third position measuring component being p Laced j 

at a first reference location; 1 

i 

said at least one third position nieasuring component being in operative | 
communication with said at least one first position measuring component and said | 
at least one second position measuring component j 

53. The system of claim 52 where said operative communication between said at 
least one first position measuring component and said at least one third position 

i 

I measuring component enable to measure the position of said at least one Hr5t medical 

i 

l scanning device with respect to said first reference location; 

; and said operative cornmunitalion between said at least one second position 

| measuring component and said at least one third position measuring component 

i enable to measure the position of said at legist one second medical scanning device 

; with respect to said first reference location. 



32 



P-2202-USP 



"21 . MAR . 1 999 U : 28 . EITRN PEQRL LPTZER+COHETN^ZOCK „ 



54. The system of claim 52 where said first reference location is kno wa 

55. The eystem of claim 5*2 where said first reference location is unknown. 

.*>6. Apparatus according to claim 32 where the position of the said at least one 
second medical scanning device is calculated with respect to said at least one first 
medical scanning device. 

57. Apparatus according to claim 32 where the position of ihe said at least one 
jfj second medical scanning device is calculated with respect to ihc scanning 

! !r plane/volume produced by said at least one first medical scanning device. 

I "si 

! J ! 58. Apparatus according to claim 32 where die position of the scanning 

I ^ plane/volume produced by said at least one second medical scanning device is 

calculated with respect to said at least one firs l medical scanning device. 

59. Appararus according to claim 32 where the position, of the scanning 
plane/volume produced by said at least one second medical scanning device is 
calculated with respect to the scanning plane/volume produced by said at least one 
first medic a) scanning device, 
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60. Apparent according to claim 32 where Che scanned plane/volume produced by 
said at least one first medical scanning device is correlated and/or fused by image 
processing tools with xfae scanned plane/volume produced by .*aid at least one second 
medical scanning device. 

61. Apparatus according to any of the claims 60, where said information 
correlation andVor fusing is used to improve said calculation of relative position 
between the scan plane/volume produced by said at least one first medical scanning 
device and the scan plane/volume produced by said at least one second medical 
scanning device. 

62. Apparatus according to claim 61 where said improvement of said calculation 
and said information correlation is performed In an iterative way. 

63 . Apparatus according to claim 32 further comprising the step of indicating to 
said position sensing system the position of a target hy marking said target on said at 
least one display screen. 

fr4. Apparatus according to claim 32 further comprising the step of indicating to 
Said position sensing system the position of a target by detecting said target by image 
processing tools, 
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65. Apparatus according to claim 32 further comprising the step f indicating to 
said position sensing system the position of said reference plane/volume by marking 
said reference plane/volume on said at least one display screen. 

66. Apparatus according to claim 32 further comprising the step of indicating to 
said position sensing system the position of said reference plane/volume by manually 
producing an indicia in the form of a signal. 

fil. Apparatus according to any of the claims 62-65, wbare the position of the said 
at least cue second medical scanning device is calculated with respect to said target 
and/or said reference plane/vokmie. 

' M* f>*S. Apparatus according to claim 32 where the position of the scanning 

: sj plane/ volume produced by the said at least one second medical scanning device is 

[ m calculated with respect to said target and/or said reference plane/volume. 

I 

luj 69. Apparatus according to claim 32 and further comprising the .step of indicating 

\y± on said at least one display screen the actual progressive motion of said at least one 

second medical scanning device, towards said target and/or reference plane/volume. 

] 

i 

j 70. Apparatus according to claim 32 and further comprising the step Of indicating 

I on said at least one display screen the deviation of said at least one second medical 

imaging device or scanning plane/volume produced by said at least one second 
1 medical scanning device from said target and/or from said reference plane/volume. 
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71. Apparatus according to claim 32 and farther comprising dxe step of adjusting 
the position of said at least one. second scanning device so u to cause it to include in 
its scan plane/volume said target or tt> cause that its scan plane/volume coincide with 
said reference plane/volume. 



i 
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ABSTRACT 

Systems and methods for medical diagnostic and for medical guided 
interventions using multiple imaging systems axe introduced. These systems and 
methods recognize the need for a relatively simple and modular way of combining 
information available from two or more medical imaging apparatus in medical 
diagnosis and in image guided surgery and therapy. Particularly these methods enable 
to minimize mechanical constraints involved in a cooperative operation of several 
medical scanning devices. 

The apparatus and methods introduced in the present invention enable to 
measure the relative position between different medical imaging devices and between 
the image planes and/or image volumes produced by them by means of using a 
position measuring system based with attachable position measuring components. 
This facilitates image fusing when images of die same plane/volume are available 
from different medical imaging systems. Additionally/alternately it enahles to position 
a second medical imaging device over a desired area/vojume according to information 
received from the image produced by the first medical imaging device. 
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